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(54) Image data encoding system and image Inputting apparatus 

(57) An image data encoding system is disclosed, 
that comprises a discrete cosine transforming means 

(101) for discrete-cosine transforming the original 
image, an electronic watermark data embedding means 

(102) for embedding the electronic watermark data 

(103) in the data that has been transformed by the dis- 
crete cosine transforming means (101). and a data 
selecting means (106; 110) for selecting the output sig- 
nal (107) of the discrete cosine transforming means 
(101) or the output signal (108) of the electronic water- 
mark data embedding means (1 02). 

Another image data erxxxling system is also dis- 
closed, that comprises an electronic watermark embed- 
ding means (404) for embedding electronic watermark 
data selected from a plurality of types (408(0),.... 408(n)) 
of electronic watermark data to the digital image data 
(401). wherein at least one of the plurality of types 
(408(0) 408(n)) of electronic watermark data is pre- 
determined electronic watermark data that does not 
affect the digital image data (401) even if the electronic 
watermark data is embedded in the digital image data 
(401). 
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Description 

Background of the Invention 

Reld of the Invention: 

The present invention relates to a digital image 
processing system and. in particular to an Image data 
encoding system for embedding identification data with 
special information (hereinafter, referred to as electronic 
watermark data) to a digital image. In addition, the 
present invention relates to an image inputting appara- 
tus for use in. for example, a personal computer and, in 
particular, to an image inputting apparatus equipped 
with an illegal copy prohibiting function. 

Description of the Related Art 

In recent years, the act of illegally copying digital 
images causes a social problem. To prevent digital 
images from being illegally copied, an 

encryption system has been proposed. In this sys- 
tem, digital image data is encrypted. Only a reproducing 
system with a valid decryption Key can reproduce the 
encrypted digital image data. However, in such a sys- 
tem, once encrypted data is decrypted, there is no way 
to prevent the data from being copied any more. 

The purpose of a conventional illegal copy prohibit- 
ing method for an image inputting apparatus was to pre- 
vent the instance of copying image data. 

Fig. 9 is a block diagram showing an example of an 
image inputting apparatus equipped with a conventional 
illegal copy prohibiting function. An input image is sup- 
plied to image pickup means 901, analog-to-digital con- 
verting means 902. converting means 903. quantizing 
means 904. and variat>le-length encoding means 905. 
After the input image is converted irrto compressed 
image data such as an MPEG data stream, the resultant 
data is supplied to scrambling means 906. Scrambling 
means 906 scrambles the input data and outputs com- 
pressed and scrambled image data. The compressed 
and scrambled image data can be reproduced only by 
an apparatus with a de-scrambling function. 

As explained above, in the conventional system, 
images are saambled to be prevented from being ille- 
gally copied. 

In the conventional system, once scrambled 
images were desaambled, it was impossible to prevent 
them from being illegally copied. 

In addition to such a conventional system, in order 
to prevent bills and securities from being illegally cop- 
ied, a method for embedding identification information 
in ^xel components of an image has been proposed in. 
for example. Japanese Patent l^d-Open Putsfication 
Nos. 4-351 164. 6-22062. and 6-221 19. 

In the method for embedding identification informa- 
tion to pixel conponents of an image, there was the dis- 
advantage that ^e identification information could be 



easily forged and removed. 

Therefore, a method for embedding electronic 
watermark data in a digital image has been proposed to 
prevent digital images from being illegally used and cop- 
5 ied. 

There are two types of electronic watermark data 
for digital images, i.e. visible electronic watermark data 
and invisible electronic watermark data. 

The visible electronic watermark data is composed 

10 of special characters or synrix)ls so that it can be recog- 
nized by visual sensation. Although the visible elec- 
tronic watermark data causes deterioration of tiie image 
quality, the user of the digital image can distinguish it 
from a forged one, whereby illegal circulation of bills 

15 securities can be prevented. 

An exanple of a method for enr^edding visible elec- 
tronic waternr^ark data in an electronic image is dis- 
closed in Japanese Patent Laid-Open Publication No. 8- 
241403. In this method, when visible electronic water- 

20 mark data is confined with an original image, only the 
brightness of pixels corresponding to an opaque portion 
of the electronic watermark data is varied, not color 
components. In this method, scaling values whk;h vary 
tiie brightness components of the pixels are determined 

25 corresponding to color components, random numbers, 
pixel values of electronic watermark data, or the like. 

On the other hand, the invisit>le electronic water- 
mark data is embedded in an image in such a manner 
tiiat the electronic watermark data does not affect the 

30 image quality. Thus, since the invisible electronic water- 
nnark faintly deteriorates the image quality, the deterio- 
ration is not perceivable by visual sensatlon.When 
special information that identifies a copyright holder of a 
original image is embedded in the form of the electronic 

35 watermark data, even after the image has been illegally 
copied, the copyright holder of the image can be identi- 
fied by detecting the electronic watermark data. In addi- 
tion, in the case tiiat information inhibiting dupticatfon is 
embedded in a image in the form of electi'ic watermark 

40 data, when a relevant reproducing unit such as VTR 
detects the information, the unit can inform the user that 
the diplication of tiie image is inhi>fted or the unit can 
prevent duplication of the inr^ge by activating duplica- 
tion inhibiting mechanism. 

45 As one method for embedding invisible electronic 
watermark data in a digital image, special infornr^tion 
representing invisible electronic watermark is embed- 
ded in a portion where the infornrtation ^intly affects the 
picture quality such as the least significant bits (LSBs) 

50 of pixel data. However, in tiiis method, it is easy to erase 
the electronic watermark data from the image. For 
example, with a low-pass filter, the information of LSBs 
of the pixel data can be removed. Additionally, in tiie 
tn^ge compressing process, redundant data tiiat faintly 

55 affects the image quality is removed so as to reduce the 
data amount and the electric watermark data is embed- 
ded in the place where redurxiant data exists. Thus, 
when the image conpressing process is performed, the 
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electronic watermark data is lost. Consequently, H is dif- 
ficult to detect the electronic waternnark data of an 
iniage that has been conrpressed. 

To solve this problem, a method for transforming an 
image into frequency components and embedding elec- 
tronic watermark data in the frequency spectrum has 
been proposed (Nikkei Electronics, p. 13. No. 660. April 
22, 1996). In this method, since electronic watermark 
data is embedded in frequency components, even if an 
image process such as a compressing process or a fil- 
tering process is performed for an Image, the electronic 
watermark data is not lost. In addition, when random 
numbers that follow a normal distribution are used as 
electronic watermark data, different pieces of electronic 
watermark data do not interfere with each other. TTius, it 
is difficult to destroy the electronic watermark data with- 
out largely deteriorating the image. 

Referring to Fig. 10. the method for embedding 
electronic watermark data in an image is performed as 
follows. First of all. a discrete cosine transforming 
means 1020 transforms an original image into fre- 
quency components. In the frequency components, a 

components are selected as f{1), f(2) f(n) according 

to amplitude order. Electronic watermark data pieces 
w(1), w(2) w(n) are extracted from random data fol- 
lowing a normal distribution with means = 0 and vari- 
ance = 1. An electronic watermark data embedding 
means 1030 calculates the following equation for each i: 

F(i) = fO) + a|f(OI • w(i). 

where 1 ^ t ^ n and where a is a scaling factor. Finally, 
image data in which electronic watermark data has 
been embedded is obtained by transforming F(0 by 
inverse discrete cosine transform. 

TTie electronic watermark data is detected in the fol- 
lowing manner. In this case, it is assumed tfiat the orig- 
inal image and electronic watermark data candidate set 
{w(i)} (where i = 1, 2. .... n) are known. 

With reference to Fig. 11 , a discrete cosine trans- 
forming means 1 120 transforms an image in which elec- 
tronic watermark data has been ent)edded into 
frequency conrtponents F(1). F(2). .... F(n). A discrete 
cosine transforming means 1110 transforms original 

image data into frequency components f(1), f(2) f(n). 

With f(i) and F(i), electronic watermark data estimated 
values W(i) are calculated and extracted by the follow- 
ing equation: 

W(i) = (F(i)-f(i))/f(i). 

Next, an inner product calculating means 1140 calcu- 
lates the statistical similarity of w(i) and W(i) by the fol- 
lowing equation: 

C = W*w/(WD*wD). 

where W = (W(1), W(2). .... W{n)); w = (w(1). w(2). .... 



w(n)); WD = absolute value of vector W; and wD = abso- 
lute value of vector w. A statistical similarity determining 
means 1160 determines that relevant electronic water- 
nnark data has been embedded in a relevant image 

5 when the value of C is equal to or larger than a prede- 
termined value. 

If the copyright holder of images embeds electronic 
watermark data in the images, the electronic watermark 
data is effective to check out inr^ges that the holder 

10 doubts is illegally copied. Fig. 12 is a block diagram 
showing an image data encoding system with such an 
electronic watermark data embedding means according 
to a related art reference. Discrete cosine transforming 
means 1201 orthogonally transforms the original in^ge 

IS data in time domain into data in frequency domain. 
Electronic data embedding means 1202 embeds elec- 
tronic watermark data 1203 in the data in frequency 
domain. Quantizing means 1204 quantizes the data in 
which the electronic watermark data has been embed- 

20 ded. Encoding means 1 205 encodes the quantized data 
and outputs the resultant MPEG data. 

The aforementioned conventional encoding system 
always embeds electronic watermark data in a relevant 
image. Although the image faintiy deteriorates as the 

25 electronic watermark data is embedded in frequency 
components, it is not that the image does not at all dete- 
riorate. Therefore, another image encoding system hav- 
ing no means for embedding electric watern^rk data is 
required when image should not be embedded witii 

30 electrk; watermark data, especially when the quality of 
the image should be valued. 

Summary of the Invention 

35 An object of the present invention is to provide an 
encoding system that generates not only erKoded data 
of image in which electric watermark data is embedded 
but also encoded data of image in which electric water- 
mark data is not embedded. 

40 Another object of the present invention is to provide 
an image inputting apparatus tiiat generates not only 
encoded data of image in which electric watermark data 
is embedded but also encoded data of image in which 
electric watermark data is not embedded. 

45 According to one aspect of the present invention, 
there is provided an image data encoding system for 
entiedding electronic watermark data to an original 
image, which comprises: disaete cosine transforming 
means for disaete-cosine transforming the original 

50 image; electronic watermark data embedding means for 
embedding the electronic watermark data in the data 
that has been transformed by the discrete cosine trans- 
forming means; and data selecting means for selecting 
the output signal of the disaete cosine transfaming 

55 means or tiie output signal of the electronic watermark 
data embedding means. 

The image data encoding system further com- 
prises: a flip-flop connected to tiie data selecting 
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means, wherein the data selecting means selects the 
output signal of the disaete cosine transforming means 
or the output signal of the electronic watermark data 
embedding means correspondng to information stored 
in the f lip-f lap. 5 

In the image data encoding system, the data select- 
ing means selects the output signal of the discrete 
cosine transforming means or the output signal of the 
electronic watermark data embedding means corre- 
sponding to an external signal. io 

According to another aspect of the present Inven- 
tion, there is provided an image data encoding system 
for encoding digital image data in a predetermined 
encoding manner and outputting the resultant image 
data, which comprises: an electronic watermark 15 
embedding means for embedding electronic watermark 
data selected from a plurality of types of electronic 
watermark data to the digital image data, wherein at 
least one of the plurality of types of electronic water- 
mark data is predetermined electronic watermark data 20 
that does not affect the digital image data even if 
embedded in the digital image data. 

In the image data encoding system, the predeter- 
mined electronic watermark data is composed of other 
than random numbers generated by an algorithm corre- 25 
spending to a normal distribution. 

The image data encoding system further com- 
prises: transforming means for transforming the digital 
image data into frequency components and outputting 
the resultant data to the electronic watermark data 30 
embedding means; quantizing means for quantizing the 
data in which electronic watermark data has been 
embedded by the electronic watermark data embedding 
means: and a variat)le-length encoding means for 
encoding output data of the quantizing means into vari- 35 
able-length code. 

According to still another aspect of the present 
invention, there is provided an image data encoding 
system for encoding digital image data in a predeter- 
mined manner and outputting the resultant data, com- 40 
prising: a plurality of electronic watermark data tables 
having a plurality of types of electronic watermark cteta 
for identifying the digital image data; an electronic 
watermark data selecting means for selecting one of the 
electronic watermark data XatAes; and an electronic 45 
watermark data embedding means for enft>edding the 
selected type of electronic watermark data in the digital 
image data, wherein at least one of the electronic water- 
mark data tatries has a predetermined electronic water- 
mark data that does not affect the digital image data so 
even if embedded in the digital image data. 

In the image data encoding system, the predeter- 
mined electronic watermark data is cooposed of other 
than random numbers generated by an algorithm corre- 
sporxling to a normal distribution. 55 

The image data encoding system further comprises 
transforming means for transforming the digital image 
data into frequency components and outputting the 



resultant data to the electronic watermark data embed- 
ding means; a quantizing means for quantizing the data 
in which electronic watermark data has been embedded 
by the electronic watermark data embedding means; 
and a variable-length encoding means for encocfing out- 
put data of the quantizing means into variable-length 
code. In the image data encoding system, the predeter- 
mined electronic watermark data is composed of other 
than raixiom numbers generated by an algorithm corre- 
sponding to a normal distnlxition. 

According to the further aspect of the present 
invention, there is provided an in^ge inputting appara- 
tus, which comprises: image pickup means for obtaining 
an analog image signal; analog-to-digital converting 
means for converting the analog image signal obtained 
by the image pickup means into image data; transform- 
ing means for transfomrring the image data into data in 
first frequency domain; storing means for temporarily 
storing the data in the first frequency domain; identifica- 
tion data holding means for holding identification data; 
means for adding the identification data to the data in 
the first frequency domain and generating data in sec- 
ond frequency domain; and selecting means for select- 
ing either of the data in the first frequency domain and 
the data in the second frequency domain and outputting 
the selected data. 

In the image inputting apparatus, the transforming 
means is an orthogonal transforming means. 

The image inputting apparatus further comprises: 
compressing means for compressing and encoding the 
output signal of the selecting means. 

According to still further aspect of the present 
invention, there is provided an image inputting appara- 
tus, conrprising: image pickup means for obtaining an 
analog image signal; analog-to-digital converting 
means for converting the analog image signal obtained 
by the image pickup means into image data; transform- 
ing means for transforming the image data into data in 
first frequency domain; storing means for temporarily 
storing the image data; identification data holding 
means for holding identification data; means for adding 
the identification data to the data in the first frequency 
domain and generating data in second frequency 
domain; inverse-transforming means for inversely trans- 
forming the data in the second frequency domain into 
data in time domain; and selecting means for selecting 
either of the output signal of the inverse-transforming 
means and the output signal of the storing means. 

In the image inputting apparatus, the transforming 
means is an orthogonal transforming means and the 
inverse-transforming means is an orthogonal inverse- 
transfornr^ng means. 

The image inputting apparatus, further comprises: 
compressing means for conrpressing and encoding the 
output signal of the selecting means. 

These and other ol:jects, features and advantages 
of the present invention will become more apparent in 
light of the following detailed description of a best mode 
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embodimerrt thereof, as illustrated in the accompanying 
drawings. 

Brief Description of Drawings 

Rg. 1 is a block diagram showing the structure of an 

image data encoding system according of a first 

embodiment of the present invention; 

Rg. 2 is a block diagram showing the structure of an 

image data encoding system according to a first 

example of the present invention; 

Fig. 3 is a block diagram shewing the structure of an 

image data encoding system according to a second 

example of the present invention; 

Fig. 4 is a bk)ck diagram showing the structure of an 

image data encoding system according of a second 

embodiment of tiie present invention; 

Fig. 5 is a block diagram showing the structure of an 

image inputting apparatus according to a third 

embodiment of the present invention; 

Fig. 6 is a block diagram shewing the structure of an 

image inputting apparatus according to a third 

example of the present invention; 

Rg. 7 is a schematic diagram for explaining an 

embedment of identification data in frequency 

domain according to the third example of the 

present invention; 

Fig. 8 is a block diagram showing the structure of an 
image inputting apparatus according to a fourth 
example of the present invention; 
Fig. 9 is a block diagram showing an exanple of the 
structure of a conventional image inputting appara- 
tus; 

Fig. 10 is a block diagram for explaining an elec- 
tronic watermark data embedding method accord- 
ing to a related art reference; 
Rg. 11 is a block diagram for explaining an elec- 
tronic watermark data detecting method according 
to a related art reference; arxi 
Fig. 12 is a block diagram showing the structure of 
an image data encoding system according to a 
related art reference. 

Description of Preferred Embodiments 

Next, with reference to the accompanying drawings, 
errixxliments and exanrples of the present invention will 
be explained. 

First Embodiment of Present Invention 

With reference to Rg. 1 , an in^ge data encodng 
system according to a first embocfiment of the present 
inversion conrprises discrete cosine transforming 
means 101. electronic watermark data embedding 
means 102. electrorac watermark data 103. data select- 
ing means 106. quantizing means 104, and encoding 
means 105. Discrete cosine transforming means 101 



transforms input original image data in time domain into 
data in frequency domain. Electronic watermark data 
embedding means 102 embeds electronk; vratermark 
data 103 in the data In frequerx;y domain. Data select- 

5 ing means 106 alternatively selects output signal 107 of 
dtsaete cosine transforming means 101 or output sig- 
nal 108 of electror^c watermark data embedding means 
102. Quantizing means 104 quantizes data selected by 
data selecting means 106. Encoding means 105 

10 encodes the quantized data received from quarrtizing 
means 104 and generates MPEG data. 

Next, the operation of the system shown in Rg, 1 
will be explained. 

Discrete cosine transforming means 101 converts 

75 the original image data in time domain into data in fre- 
quency domain. Electronic watermark data embedding 
means 102 embeds electronic watermark data 103 in 
the data in frequency domain. 

Output signal 108 of electronic watermark data 

20 erTt>edding means 1 02 is sifDplied to one input terminal 
of data selecting means 106. Output signal 107 of dis- 
crete cosine transforming means 101 is supplied to an 
input terminal of electronic waternDark data embedding 
means 102. In addition, output signal 107 is supplied to 

25 the other input terminal of data selecting means 106. 
When tiie electronic watermark data 103 should be 
embedded in the original image data, data selecting 
means 106 selects output signal 108. When the elec- 
tronic watermark data 103 should not be embedded in 

30 the original image data, data selecting means 106 
selects output signal 107. 

Quantizing means 104 quantizes the data selected 
by data selecting means 106. Encoding means 105 
encodes the quantized data and outputs MPEG data. 

35 

First Example of Present Invention 

Next, with reference to Fig. 2, a first example 
according to the first embodiment of the present inven- 

40 tion will be explained. 

With reference to Rg. 2. output signal 107 of dis- 
aete cosine transforming unit 101 or outpxjt signal 108 
of electronic watermark data enri)edding unit 102 is 
alternatively selected by selecting unit 110 tiiat oper- 

45 ates corresponding to information stored in flip-flop 111. 
When the electi'onic watermark data should not be 
embedded in the image data, a logic value "0" is stored 
in flip-flop 111. When the electronic watermari^ data 
should be embedded in the original image data, a logk: 

50 value "1 " is stored in flip-flop 111. 

Dtsaete cosine transfornrung unit 101 orthogonally 
transforms original image data in time domain into data 
in frequency domain. Electronic watermark data 
embedding unH 102 embeds electronic watermark data 

55 1 03 in the data in frequency domain. 

Output signal 108 of electronic watermark data 
embedding unit 102 is supplied to one input terminal of 
selecting unit 1 10. Output signal 107 of discrete cosine 
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transforming unit 101 is supplied to an input ternrunal of 
electronic watermark data embedding unit 102. In addi- 
tion, output signal 107 of discrete cosine transforming 
unit 101 is supplied to the other input temiinal of select- 
ing unit 1 1 0. When the information of flip-flop 1 1 1 repre- 5 
sents the logical value '0\ selecting unit 110 selects 
output signal 107. When the information of flip-flop 1 1 1 
represents the logical value 'V. selecting unit 110 
selects output signal 108. 

Quantizing unit 104 quantizes the data selected by 10 
selecting unit 110. Encoding unit 105 encodes the 
quantized data and outputs MPEG data. 

Second Example pf Prgggnt Invention 

15 

Next, with reference to Fig. 3, a second example 
according to the first embodiment of the present inven- 
tion will be explained. 

Referring to Fig. 3, output signal 107 of discrete 
cosine transforming unit 101 and output signal 108 of 20 
electronic watermark data embedding unit 102 is alter- 
natively selected by selecting unit 110 corresponding to 
external signal 112. When electronic watermark data 
1 03 should not be embedded in image data, a logical 
value 0' is set to external signal 112. When electronic 25 
watermark data should be embedded in image data, a 
logical value *V is designated to external signal 112. 

Discrete cosine transforming unit 101 orthogonally 
transforms original image data in time domain into data 
in frequency domain. Electronic watermark data 30 
embedding unit 102 enft)eds electronic watermark data 
103 in the data in frequency domain. 

Output signal 108 of electronic watermark data 
embedding unit 102 is supplied to one input terminal of 
selecting unit 110. Output signal 107 of discrete cosine 35 
transforming unit 101 is supplied to an input terminal of 
electronic watermark data embedding unit 102. In addi- 
tion, output signal 107 is supplied to the other input ter- 
minal of selecting unit 110. When external signal 112 
represents the logical value '0'. selecting unit 110 40 
selects output signal 107. When external signal 112 
represents the logical value 'V, selecting unit 110 
selects output signal 108. 

Quantizing unit 104 quantizes the data selected by 
selecting unit 110. Encoding unit 105 encodes the 45 
quantized data and outputs MPEG data. 

Second Embodiment of Present Invention 

Next, with reference to Fig. 4. an image data encod- so 
ing system according to a second embodiment of the 
present invention will be explained. 

Fig. 4 is a block diagram showing the structure of 
the image data encoding system according to the sec- 
ond embodiment of the present invention. In Fig. 4, the ss 
inrmge data encoding system comprises discrete cosine 
transforming means 402, a plurality of electronic water- 
mark data tables 408(0). 408(1), 408(2)... 408(n), elec- 



tronic watermark data selecting unit 407, electrons 
watermark data ent)edding means 404. quantizing 
means 405, and encoding means 406. Discrete cosine 
transforming means 402 performs a disaete cosine 
fransfomning process for original image stream 401 to 
be encoded. Electronic watermark data tables 408(0), 
408(1), 408(2),..., 408(n) have respective electronk: 
watermark data. Electronic watermark data selecting 
urtit 407 selects one of electronic watermark data tables 
408(0). 408(1), 408(2) 408(n). Electronic water- 
mark data embedding means 404 embeds electronic 
watermark data in the data that is received from disaete 
cosine transforming means 402 and then temporarily 
stored in buffer 410. Quantizing means 405 quantizes 
data received from electronic watermark data embed- 
ding means 404. Encoding means 406 encodes data 
received from quantizing means 405 into variable- 
length code and outputs resultant MPEG data 409. 

AnDong tiie plurality of electronic watermark data 
tattles 408(0) to 408(n), watermark data table 408(0) 
has electronic data that does not affect digital image 
data. In other words, the electronic watermark data 
table 408(0) does not have random numbers generated 
by an algoritiim of generating random numbers in a nor- 
mal distribution. On the other hand, electronic water- 
mark data tables 408(1) to 408(n) have random 
numbers generated by tiie algorithm. 

Next, tiie operation of the image data encoding sys- 
tem according to tiie second embodiment of tiie present 
invention will be explained. 

Rrst of all. the case in which normal electronic 
watermark data is embedded in image data will be 
explained. Original image data 401 is extracted in the 
unit of (8 X 8 pixel) t>lock. Discrete cosine transforming 
means 402 performs a discrete cosine transforming 
process for the extracted data arxf then transforms the 
data into frequency components. Electronic watermark 
data selecting means 407 selects electronic watermark 
data from one of the electror^c watermark data tables 
408(1) to 408(n) except for electronic watermark data 
table 408(0) and outputs tiie selected electronic water- 
mark data to electronic watermark data embedding 
means 404. Electronic watermark data embedding 
means 404 embeds the selected electronic watermark 
data in tiie frequency conponents. Quantizing means 
405 quantizes data received from electronic watermark 
data en*>edding means 404. Encoding means 406 
encodes quantized data and outputs resultant MPEG 
data 409. 

Next, the case in which encoded data correspond- 
ing to original data is required is explained. Similarly to 
the normal case, original image data 401 is exti-acted in 
tiie unit of (8 X 8 pixel) block corresponding to the con- 
ventional MPEG compressing process. Discrete cosine 
to-ansforming means 402 performs a cfiscrete cosine 
transforming process for the extracted data and then 
transforms the extracted data into frequency compo- 
nents. Electi-onic watermark data selecting means 407 
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selects electronic watermark data that does not affect 
digital image data from the electronic watermark data 
table 408(0) and outputs the selected electronic water- 
mark data to electronic watermark data embedding 
means 404. Electronic watermark data embedding 5 
means 404 embeds the selected electronic watermark 
data in the frequency components. Quantizing means 

405 quantizes the data received from electronic water- 
mark data embedding means 404. Encoding means 

406 encodes the quantized data and outputs resultant ro 
MPEG data 409. 

Third Embodiment of Present Invention 

Next, with reference to Rg. 5, the basic structure of is 
an image inputting apparatus according to a third 
enft>odiment of the present irtvention will be explained. 
With reference to Fig. 5, the image inputting apparatus 
comprises image pickup means 501 » analog-to-digital 
converting means 502, transforming means 503, storing 20 
means 507, identification data holding means 510, iden- 
tification data emt^edding means 509, data selecting 
means 508, quantizing means 504, and encoding 
means 505. Image pickup means 501 picks up an exter- 
nal image. Analog-to-digital converting means 502 con- 25 
verts an analog signal of the picked-up image into digital 
image data. Transforming means 503 transforms the 
image data in space domain into data in frequency 
domain. Storing means 507 temporarily stores the 
image data in frequerKy domain. Identification data 30 
holding means 510 hokis identification data. Identifica- 
tion data embedding means 509 embeds the identifica- 
tion data in the image data in frequency domain. Data 
selecting means 508 selects an output signal of storing 
means 507 or an output signal of identification data 35 
embedding means 509. Quantizing means 504 quan- 
tizes image data. Encoding means 505 encodes the 
quantized inrtage data into variable-length code. 

Next, the operation of the image inputting appara- 
tus according to the third embodiment of the present 40 
invention will be explained. Image pickup means 501 
picks up an external image and outputs the analog sig- 
nal of the picked-up image. Anabg-to-digital converting 
means 502 converts the analog signal into digital image 
data and outputs the digital image data. Transforming 45 
means 503 orthogonally transforms the image data in 
space domain into image data in frequency domain and 
outputs the resultant image data. Storing means 507 
tenrporarily stores the image data in frequency domain. 
Identilrcation data hokling means 51 0 hokfs and outputs so 
identification data, klentif ication data embedding means 
509 embeds the identification data in the image data in 
frequency domain and outputs the resultant data. Data 
selecting means 508 selects an output signal of storing 
means 507 or an output signal of kfentification data ss 
embedding means 509 and outputs the selected signal. 
The quantizing means 504 quantizes the image data 
arKi outputs the resultant data. The encoding means 



505 encodes the quantized image data into variable- 
length code and outputs compressed image data. 

Third Exanrple of Prese nt Invention 

Next, with reference to Fig. 6, a third example 
according to tiie third embodiment of the present inven- 
tion will be explained. Referring to Fig. 6, CCD image 
pickup device 601 picks up an external image and out- 
puts the analog signal of the picked-up image. Analog- 
to-digital converting unit 602 converts the analog signal 
into digital image data and outputs the digital image 
data. 

Discrete cosine transforming unit 603 orthogonally 
transforms the image data in space donnain into data in 
frequency domain. Buffer 607 temporarily stores image 
data in frequency domain. Identification data table 610 
hdds and outputs identification data. kJentification data 
enrt»edding unit 609 embeds the identification data in 
the image data in frequency domain and outputs the 
resultant data. 

Selecting unit 608 alternatively selects an output 
signal of txjffer 607 or an output signal of klentifk:ation 
data embedding unit 609. When the output signal of 
buffer 607 is selected, tiie original image data is output. 
When the output signal of iderrlrf ication data embedding 
unit 609 is selected, image data in which the identifica- 
tion data is embedded is output. 

Quantizing unit 604 quantizes image data and out- 
puts the quantized image data. Variable-length encod- 
ing unit 605 encodes the quantized image data in 
variable-length code and outputs the resultant MPEG 
data. The MPEG data is supplied to for example a per- 
sonal computer, a storage medium processing unit 
(such as an optical magnetic medium), a network 
processing unit (that transmits the data to a network 
line), or a radio media processing unit (that transmits 
the data to a radio channel). 

Next, with reference to Rg. 7, an emt>edding 
method of Identification data will be explained. When 
image data in space domain is orthogonally trans- 
formed into data in frequency domain by disaete cosine 
transforming unit 603, a frequency spectrum 701 shown 
in Fig. 7 is generated. Wentifk^ation data table 610 out- 
puts the identification data with a frequency spectrum 
704 shown in Rg. 7. Frequency spectrum 704 is similar 
to the spectrum 701. When adding unit 702 adds fre- 
quency spectrum 704 of the identification data to fre- 
quency spectrum 701 of the original image, a frequency 
spectrum 703 in which the identification data is embed- 
ded is obtained. 

To extract the identification data, a subtracting unit 
(not shown) extracts frequency spectrum 701 of the 
original image from frequency spectrum 703 in which 
the identification data is emt>edded and obtains fre- 
quency spectrum 704 of the identification data. Thus, 
the identification data can be easily extracted. 



7 



13 



EP0 859 337 A2 



14 



Fourth Example of Present Invention 

Next, with reference to Fig. 8, a fourth exannple 
according to the third embodiment of the present inven- 
tion will be explained. Refenring to Rg. 8. CCD inrtage 
pickup device 601 picks up an external image and out- 
puts the analog signal of the picked-up image. Analog- 
to-digital converting unit 602 converts the analog signal 
into digital image data and outputs the image data. 
Buffer 807 temporarily stores the digital image data. 

Discrete cosine transforming unit 603 orthogonally 
transforms image data in space domain into data in fre- 
quency domain and outputs the resultant data. Identifi- 
cation data table 610 holds and outputs identification 
data. Identification data embedding unit 609 embeds 
the identification data in the image data in frequency 
domain and outputs the resultant data. Inverse discrete 
cosine transforming unit 81 1 transforms the image data 
in frequency domain into data in space domain and out- 
puts the resultant image data. The image data in fre- 
quency domain may be converted into the inr^ge data in 
space domain by fast Fourier transforming method 
rather than the discrete cosine transforming method. 

Selecting unit 808 alternatively selects the output 
signal of buffer 807 or the output signal of inverse dis- 
crete cosine transforming unit 811. When the output sig- 
nal of buffer 807 is selected, the original image data is 
output. When the output signal of inverse discrete 
cosine transforming unit 81 1 is selected, the image data 
in which the identification data is embedded is output. 

Since the embedding method of the identification 
data according to the fourth exanrple is the same as that 
of the third example, the description thereof is omitted. 
To extract the identification data, the discrete cosine 
transforming means orthogonally transforms the image 
data in space domain into the image data tn frequency 
domain. Thereafter, a subtracting unit (not shown) sub- 
tracts the frequency spectrum of the original image data 
from the frequency spectrum in which the identification 
data is embedded and obtains the frequency spectrum 
of the identification data. 

As explained above, according to the present inven- 
tion, since both image data with electronic watermark 
data and image data without electronic waternrtark data 
can be encoded by one encoding system rather than 
two encoding systems, the hardware scale can be 
remarkat)ly reduced. 

According to the present invention, even if image 
data is illegally copied, it can be identified. This is 
becai^e identification data has been embedded in the 
image data. Thus, by detecting the identification data, 
the route of the illegal copy can be ti-acked. 

In addition, when identification data is deleted or 
desti-cyed and thereby original image data tfiereof is ille- 
gally copied, the image quality of the image data 
renrarkably deteriorates. Thus, the image data can be 
prevented from being illegally forged and copied. 

Although the present invention has been shown 



and explained with respect to a best mode embodiment 
thereof, it should be understood by those skilled in the 
art that the foregoing and various other changes, omis- 
sions, and additions in the form and detail thereof may 
5 be made tiieran without departing from tiie spirit and 
scope of the present invention. 

Claims 

10 1, An image data erKoding system for embedding 
electronic watermark data to an original image, 
which comprises: 

discrete cosine transforming means (101) for 
IS discrete-cosine transforming said original 

image; 

electronic watermark data embedding means 
(102) for embedding said electi-onic watermark 
data (103) in the data which has been trans- 
20 formed by said discrete cosine transforming 

means (101); and 

data selecting means (106; 110) for selecting 
the output signal (107) of said discrete cosine 
transforming means (101) or tiie output signal 
25 (108) of said electronic watermark data 

embedding means (102). 

2. The image data encoding system as set forth in 
daim 1 , which furtfier comprises: 

30 

a flip-flop (111) connected to said data select- 
ing means (106), 

wherein said data selecting means (106; 110) 
selects the output signal (107) of said discrete 
35 cosine transforming means (101 ) or the output 

signal (108) of said electronic watermark data 
embedding means (102) corresponding to 
inforniation stored in said flip-flop (1 1 1). 

40 3, The image data encoding system as set forth in 
daim 1 or 2, 

wherein said data selecting means (106; 110) 
selects the output signal (107) of said discrete 
cosine transforming means (101) or the output sig- 
45 nal (108) of said electronic watermark data embed- 
ding means (102) corresponding to an external 
signal (112). 

4. An image data encoding system for encoding digital 
50 image data (401) in a predetermined encoding 
manner and outputting the resultant image data, 
which comprises: 

an electronic watermark embedding mearts 
55 (404) for enrt)edding electronic watermark data 

selected from a plurality of types of electronic 

watermark data (408(0). 408(1), 408(2) 

408(n)) to said digital image data (401). 
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wherein at least one of the plurality of types of 
electronic watermark data (408(0),..-,408(n)) Is 
predetermined electronic watermark data 
which does not affect said digital image data 
(401) even rf embedded in said digital image 5 
data (401). 

5. An Image data encoding system for encoding digital 
image data (401) in a predetermined nr^nner and 
out-putting the resultant data, conrprising: 10 

a plurality of electronic watermark data iabHes 
(408(0). 408(1). 408(2) 408(n)) having a plu- 
rality of types of electronic watermark data for 
Identifying said digital Image data (401); is 
an electronic watermark data selecting means 
(407) for selecting one of said electronic water- 
mark data tables; arxi 

an electronic watermark data embedding 
means (404) for enrt>eddlng the selected type 20 
of electronic watermark data in said digital 
Image data (401), 

wherein at least one of said electronic water- 
mark data tables (408(0),...408(n)) has a pre- 
determined electronic watermark data which 25 
does not affect said digital image data (401) 
even if embedded In the digital Image data 
(401). 

6. The image data encoding system as set forth in so 
claim 4 or 5, which further comprises: 

transforming means (402) for transforming said 
digital Image data (401) into frequency compo- 
nents and outputting the resultant data to said 35 
electronic watermark data embedding means 

(404) ; 

a quantizing means (405) for quantizing the 
data In which electronic watermark data has 
been embedded by said electronic watermark 40 
data ent>edding means (404); and 
a variable-length encoding means (406) for 
encoding output data of said quantizing means 

(405) Into variable-length code. 

45 

7. The image data encoding system as set forth In 
anyone of the foregoing claims. 

wherein said predetemiined electronic watermark 
data Is composed of other than random numbers 
generated by an algorithm corresponding to a nor- so 
mal distribution. 

8. An Image Inputting apparatus, which comprises: 

image pickup means (501; 601) for obtaining ss 
an analog image signal; 
analog-to-digital converting means (502; 602) 
for converting said analog image signal 



obtained by said Image pickup means (501; 
601) Into image data; 

transfomiing means (503; 603) for transforming 
said Image data Into data (701) in first fre- 
quency donrmin; 

storing means (507; 607) for temporarily stor- 
ing the data (704) In said first frequency 
domain; 

identification data hokJing means (510; 610) for 
holding Identification data (704); 
means (509; 702) for adding said Identification 
data (704) to the data (701) in the first fre- 
quency domain and generating data (703) in 
second frequency domain; and 
selecting means (508; 608) for selecting either 
of the data (704) In said first frequency domain 
and the data (703) in said second frequency 
domain and outputting the selected data. 

9. The Image Inputting apparatus as set forth in daim 
8. wherein said transforming means (503; 603) Is 
an orthogonal transforming means. 

10. An Image inputting apparatus, comprising: 

image pickup means (601) for obtaining an 
analog image signal; 

analog-to-digltal converting means (602) for 
converting said analog image signal obtained 
by said image pickup means (601) into image 
data; 

transforming means (603) for transforming said 

Image data Into data (701) in first frequency 

domain; storing means (807) for temporarily 

storing said image data; 

Identification data holding means (610) for 

holding identification data (704); 

means (702) for ackling the Identification data 

(704) to the data (701) In said first frequency 

domain and generating data (703) In second 

frequency domain; 

Inverse-transforming means (811) for inversely 
transforming the data in said second frequency 
domain into data in time domain; and 
selecting means (808) for selecting either of 
the output signal of said Inverse-transforming 
means (81 1) and the output signal of said stor- 
ing means (807). 

11. The image Inputting apparatus as set forth In daim 
10, 

wherein said transforming means (503; 603) is an 
orthogonal transforming means and said Inverse 
transforming means (81 1) is an orthogonal inverse- 
transforming means. 

12. The image inputting apparatus as set forth In any- 
one of the daims 8 to 1 1 , which further comprises: 
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compressing means (504; 604) for compris- 
ing arKl encoding the output signal of said 
selecting means (508; 608; 808). 
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